Dissipation: The phase-space perspective 
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We show, through a refinement of the work theorem, that the average dissipation, upon perturb- 
ing a Hamiltonian system arbitrarily far out of equilibrium in a transition between two canonical 
equilibrium states, is exactly given by {Wdiss} = (W) — AF — kTD(p\\p) = kT(\n(p/p~)} , where p 
and p are the phase space density of the system measured at the same intermediate but otherwise 
arbitrary point in time, for the forward and backward process. D(p\\p) is the relative entropy of p 
versus p. This result also implies general inequalities, which are significantly more accurate than 
the second law and include, as a special case, the celebrated Landauer principle on the dissipation 
involved in irreversible computations. 
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Since the pioneering work of Boltzmann, the search for 
an exact microscopic expression of dissipation has been 
at the heart of (nonequilibrium) statistical mechanics. In 
this letter, we derive such an expression from first prin- 
ciples, through a refinement of the recently discovered 
work theorem by Jarzynski and Crooks [l[ . 

The second law of thermodynamics stipulates that the 
average mechanical work (W) needed to move a system 
in contact with a heat bath at temperature T, from one 
equilibrium state A into another equilibrium state B, is 
at least equal to the free energy difference between these 
states: (W) > AF = Fb — Fa- The equality is reached 
for a quasi-static process. The extra work (W) — AF 
is often referred to as the dissipated work. Contrary to 
the reversible work, the dissipated work depends on how 
the transition between the states is realized. Typically, 
one or more external control parameters are changed in 
time, following a specific protocol, between initial an final 
values. The dissipated work will depend on this protocol, 
which can in principle bring the system arbitrarily far out 
of equilibrium. Amazingly, there exists an exact, simple 
and compact microscopic expression for this dissipation. 
The key is to consider the protocol and its time-reversed 
version. We will refer with a superscript tilde to all the 
quantities measured in the time-reversed protocol. The 
central result is then the following: (Wdiss) = (W) — 
AF = kTD(p\\p) = kT{]n(p/p)), where p and p are the 
phase space densities of the system measured at the same 
intermediate but otherwise arbitrary point in time, in 
the forward and backward protocol, respectively. D(p\\p) 
is the Kullback-Leibler distance |2|, also called relative 
entropy, of p versus p. 

The derivation is similar in spirit to that of the Jarzyn- 
ski and Crooks equalities Consider a Hamiltonian 
H(q,p;X) where (q,p) represents the set of position and 
momentum variables of the system under consideration 
and A is a control parameter which is varied from an 



initial value A^ to a final value As according to a proto- 
col X(t) controlled by an external agent. The system is 
initially assumed to be in canonical equilibrium at tem- 
perature T at the value Xa of the control parameter and, 
along the protocol, is completely isolated, i.e., no energy 
is exchanged other than the work W performed by the 
external agent on the system. In the time-reversed sce- 
nario, the system is initially at canonical equilibrium at 
the same temperature T, but at the value As of the con- 
trol parameter, which is now changed according to the 
exact time-reversed protocol. 

We first set out to calculate the work W(q, p ; t) done 
along the whole process, for the specific phase trajec- 
tory that passes through the phase point (q,p) at time t. 
Since the dynamics are deterministic, there is precisely 
one such trajectory. Let us call (qo,Po) an d {qi, Pi) the 
corresponding initial and final phase points. Note also 
that there is a one-to-one correspondence with the time- 
reversed trajectory in the time-reversed protocol which, 
starting from (q±, —pi), goes through (q, —p) and finally 
into (qo, —po), cf. Fig. Q] For simplicity of notation, we 
will use the forward time to express times in both for- 
ward and backward scenarios. By conservation of total 
energy, one has that: 

W(q,p;t) = H(q 1 ,p 1 ;X B ) - H(q ,p ; X A ) (1) 
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FIG. 1: Space-time coordinates for the forward and backward 
trajectories. 



2 



Now, since the phase space density is conserved along 
any Hamiltonian trajectory, one has, in both forward and 
backward process: 

/ .s / ,n cxp[-/3iJ(g ,Po; A^)] , s 

p{q,p,t) = p{qo,po,t ) = (2) 

Za 

cxp[-f3H(q 1 , -pi;X B )) 
Z B 



P(q,-P,t) = p(qi,-pi,ti) 



where Za and Zb are partition functions at the equilib- 
rium states A and B, respectively. These expressions 
allow us to eliminate the Hamiltonian (which is sup- 
posed to be even in the momenta, or more precisely time- 
reversible) at initial and final times in favor of the phase 
space density at any intermediate time point. Eq. (JTJ) , 
yields the following generalized Crooks relation: 



exp{(3[W(q,p;t)-AF}} = 



p{q,p,t) 
p(<7, -p, t) 



(3) 



where AF = —kT(\nZB — \tiZa) is the free energy dif- 
ference between the final and initial equilibrium states. 
If we now rewrite Eq. ([3|) as follows: 



W(q,p;t) - AF = kT 'In 



p(q,p,t) 
p{q,-p,t) ' 



(4) 



the average work reads: 



(W)-AF = kT f dqdp p(q,p,t) In J° (g ' P '*> 

J p{q, -p, t) 

= kTD(p{q,p,t)\\p{q,-p,t)). 



(5) 



We conclude that the dissipated work is fully re- 
vealed by the phase space density of forward and back- 
ward processes at any intermediate time of the ex- 
periment. It is particularly interesting to note that 
this dissipation, cf. r.h.s. of Eq. ([5]), takes the form 
of the relative entropy (Kullback-Leibler distance Q) 
D(p\\p) — J dqdp p\n(p/p) between the forward and 
backward probability distributions p and p. This sim- 
ple result calls for a number of more specific comments. 
First, since a relative entropy is strictly non-negative, 
we conclude that the dissipation cannot be negative, in 
agreement with the second law. Second, the dissipa- 
tion results from the asymmetry between the forward 
and backward protocols: it is zero only when p(q,p,t) — 
p(q,—p,t). In fact, Stein's lemma relates D(p\\p) di- 
rectly to the difficulty of statistically distinguishing for- 
ward versus backward trajectories. This is consistent 
with the general observation that dissipation is the re- 
sult of the breaking of detailed balance The above 
expression is also consistent with a proposal, linking the 
time-asymmetry of the Kolmogorov-Sinai entropy to the 
entropy production of the dynamical system [4|. Third, 
the total dissipation, cf. the l.h.s. of Eq. ©, is obviously 
a constant, independent of time. Yet the densities in 



the r.h.s. of Eq. ([5]) can be evaluated at any interme- 
diate time t. This time-independence follows from the 
observation that the relative entropy of densities obey- 
ing the same Liouville equation, is constant in time [5(. 
Fourth, the evaluation of the dissipated work in general 
requires full knowledge of the phase space density, even 
though only at one particular instant of time. That such 
detailed information may be needed is consistent with 
the generality of the result, which is valid no matter how 
far the system is driven out of equilibrium. However, one 
can get away from this apparently stringent requirement, 
by invoking the chain rule for relative entropy 0. Ac- 
cording to this rule, the relative entropy decreases upon 
coarse graining. The equality Eq. ([5]) is then replaced by 
an inequality. It is instructive to give a direct derivation 
of this result. 

Consider a partition of the entire phase space, consist- 
ing of K non-overlapping subsets Xj, (j = 1) • • • > K). Wc 
introduce the corresponding coarse grained phase densi- 
ties 



Pj 



p{q,p)dqdp; pj = p(q, -p,t)dqdp 



where the Xj is identical to Xj i apart from the inversion 
of all momenta. By integration of Eq. ((3]) over the set 
Xj, we obtain the following detailed Jarzynski equality: 



-pw\ . _ 



J xj p(q,p,t)e-^ w ^dqdp _ p. 



-/3AF 



Pj 



Pj 



(6) 

By Jensen's inequality, Eq. ([6]) implies a second-law like 
inequality: 



(W)j > AF + kTln [ Q ) ; -OH, 



(7) 



where we have included, for later reference, the inequality 
that arises by considering the backward process. Finally, 
by performing an average over the different subsets, one 
finds: 

(W) = ]T Pj (W)j > AF + kTD(p 3 \\pj) (8a) 
j 

(W) - ^PiffijZ-AF + kTDfa^). (8b) 

3 

where the discrete version of relative entropy is defined 

by d (Pj\\Pj) = Ej Pi HPj/Pj)- 

We conclude that, when full information of the phase 
density is not available, a coarse grained relative entropy 
still provides a lower bound for the dissipative work, sig- 
nificantly improving the classical one given by the second 
law. How well this bound approaches the total dissipa- 
tion will depend on how far the process is from the quasi- 
static regime. In particular, in the latter case, any par- 
tition will do, and the relative entropy is always identi- 
cally zero. More interestingly, one expects that a coarse- 
grained partition will suffice in case of separation of time 
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scale between fast and slow variables. Indeed, in this case 
and for a protocol on the slow time scale, the fast vari- 
ables will be essentially at equilibrium and all the dissipa- 
tion is captured in the time-asymmetry contained in the 
slow variables. We note however that in this reduced set 
of variables, trajectories can, unlike in full phase space, 
cross each other. A more detailed analysis reveals that 
full information is then not captured by measurement at 
a single time, but should in general be carried out at all 
times, in agreement with, e^g., the entropy production of 
Markovian processes 0, |j, [(f . 

To illustrate the power and usefulness of our results, 
we turn to a number of specific examples. We first con- 
sider the quenching of a system described by the Hamil- 
tonian H (x; A), in contact with a heat bath at tempera- 
ture T. The equilibrium probability distribution to ob- 
serve the state x is given by a Boltzmann distribution 
p(x; A) = exp(— (3H(x; \))/Z\ with Z\ the normalization 
factor (partition function). We now perturb this equi- 
librium by the following irreversible quench: the control 
parameter is changed instantaneously from the value A to 
the value A' at a specific time and the experiment termi- 
nates at any later time. In the backward process, we start 
from equilibrium at A' and quench back to A. Since the 
state x does not change during the instantaneous quench, 
the work in the forward process is: 

(W) = J dx [H(x; A') - H(x; A)] p(x; A) (9) 

Now consider a partition, infinitely fine in the position co- 
ordinates (disregarding all the other degrees of freedom, 
in particular those of the heat bath) and measure the 
coarse grained distribution p(x, t) at the time of quench. 
We note that the distributions prior to the quench are 
the equilibrium distribution from which one started, i.e., 
p(x; A) and p(x; A') for forward and backward scenario 
respectively. Turning to Eq. (|7|), the role of pj and pj 
are thus played by p(x; A) and p(x; A'), hence: 



(W) >AF + kr[dx p(x] A) In - 
J V 



p(x; A) 



(x;A') 



(10) 



Using the Boltzmann probability distributions together 
with AF = -kT\n(Zy/Z\), a comparison with Eq. © 
reveals that the equality sign holds in Eq. (fTU|) . We con- 
clude that in this case the coarse-grained partition cap- 
tures the full dissipation. 

Turning to a more complicated situation, we consider 
an overdamped Brownian particle in contact with a heat 
bath at temperature T, moving in a harmonic potential 
whose spring constant varies from k to n' during a finite 
time r. For r — > 0, one recovers the quenching experi- 
ment described above with (W) given by Eq. ([9|) (with a 
harmonic Hamiltonian). For r — > oo, one approaches the 
quasi-static limit with (W) = AF. In Fig. [5] we compare 
the dissipative work (W) — AF, obtained from Langevin 



simulations, with the relative entropy measured at the 
middle of the transition with a fine partition (Ax = 0.1) 
and a coarse partition (Ax = 1.0). The relative en- 
tropy is always below the dissipative work, consistent 
with Eq. (jSaj) . For the fine partition the relative entropy 
coincides with the dissipative work as r approaches the 
quenched limit, in agreement with Eq. (fT0|) . Note that 
the refinement of the partition in estimating the dissipa- 
tion is most effective close to the quenched limit. 

In our final illustration, we show that Eqs. |(5J| include 
as a special case the celebrated Landauer principle on 
the minimal dissipation of irreversible computations. We 
consider a Brownian computer 0, Hoi . 11 1 , consisting of a 
one-dimensional overdamped Brownian particle at tem- 
perature T in a time-dependent potential varied by an 
external agent according to a given cyclic protocol shown 
in Fig. [3J Since it involves spontaneous symmetry break- 
ing followed by forced symmetry breaking, this process 
is analogous to the Szilard engine [l2j, whereas the re- 
verse, starting from b, is analogous to the Landauer's 
restore-to-zero process [1, 0, [l(| ■ 

The coarse resolution measurement is made at the 
stage b of the forward cycle by partitioning position space 
into two sets, \R — { x '■ x > 0} and \l = {x : x < 0} 
(See Fig. [3]). In the forward process, we have by sym- 
metry that pa = pi = 1/2. In the backward process the 
large majority of trajectories will be forced by the exter- 
nal bias towards the location of the cell \R & t stage d. 
However, since the height of the barrier is finite, trajec- 
tories can still thermally cross over to \l before reaching 
the filtering stage b. Therefore, the probabilities pn and 
Pl, while being close to 1 and for strong forcing, will 
otherwise depend on the applied force, barrier height, 
temperature and processing speed. 

In this example, we focus on the validity of Eq. Q, 
i.e., the average work for each macroscopic trajectory, R 




FIG. 2: Dissipation of Brownian particles in a harmonic po- 
tential with spring constant varying from k = 2 to k' = 1 
during a time interval r. Solid line is dissipative work directly 
obtained from simulation. Dashed and dotted lines indicate 
the lower bound of the dissipative work estimated from the 
relative entropy. 
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or L. For strong forcing, p R = 1, Eq. ||7J) reads: 
(W) R >-kTln2>-(W) R (p« = l) 



(11) 



This expression includes Landauer's principle in the case 
of the backward process, namely, that the erasure of one 
bit of information must be accompanied by the dissipa- 
tion of an energy fcTln2. For the Szilard engine, i.e., 
the forward process, one recovers the apparent viola- 
tion of the second law by R trajectories when the equal 
sign in Eq. {TTJ) holds: (W)r = -fc7Tn2. Concomi- 
tantly, along the L path, we have p~L — > 0, or, more 
precisely, pz ~ exp(— V/kT), V being the height of the 
barrier, and the lower bound given by Eq. (|8a[) is, ap- 
proximately, (W) l > V. The L trajectories correspond 
to a "wrong" measurement in the Szilard engine and 
they dissipate an energy significantly bigger than the en- 
ergy AT In 2 extracted from the thermal bath in the R 
trajectories. Consequently, the overall dissipation for the 
engine is positive, in accordance with the second law. 

In Fig. [3] we show the results of numerical simula- 
tions of the corresponding overdamped Langevin equa- 
tion. Average work performed by the Brownian particles 
residing in the right well at the stage b in the forward and 
backward processes is plotted for different values of the 
processing time r. The bound using and p R measured 
directly in the simulation is alao_ plotted. The bound 
is always between (W)r and — (W)r in agreement with 
Eq. I|7|). Note that the Landauer principle, contained in 
breaks down in the quasi-static limit r — > oo, since 
the Brownian particle equilibrates by crossing the barrier. 




FIG. 3: Top: Cyclic variation of a model potential. The ar- 
rows indicate the forward protocol corresponding to the Szi- 
lard engine. The backward process is a model for recording 
and erasing information. Bottom: Partitioned average work 
as a function of processing time r: (W)r (solid line) and 
— (W)r (dashed line). The bound (JJJ using the coarse grained 
distribution is shown by the dotted line. 



In this process, the stored information is lost, pn — > 1/2, 
and the (dissipated) work goes to zero. Nevertheless, the 
inequality ((TJ) is always satisfied. 



As the Jarzynksi equality itself has generated a lot 
of debate, a critical discussion of the above theory is 
in place. The term dissipation is usually associated to 
entropy production. To make this connection, we note 
that the system is not at equilibrium at the final stage of 
the (forward) experiment. We can however reconnect it 
to a heat reservoir and let it relax to its canonical equi- 
librium state for A = Xb and temperature T. In doing 
so, it will exchange the dissipated work under the form 
of heat with the bath, resulting in an entropy produc- 
tion AS = k(ln(p/p)). One could ask whether the dis- 
connection or reconnection of the system with the bath 
adds significant terms to the work and/or the free energy. 
Apart from the answers given to these issues in the con- 
text of the Jarzynski equality itself [13] , we are concerned 
here with the average total work, which is much larger 
than these energies for large systems and long enough 
operation times. Finally, the above derivation relies on 
a continuous transformation of the Hamiltonian, exclud- 
ing, for example, free expansion. This limitation reflects 
the need for considering the time-reversed process. 
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